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ABSTRACT 



Almost all 'of the published work on the philosophical 
question of mechanical intelligence has argued in favor of one or the 
other of the polarities of possible .positions, it is however possible 
to take a position between these two extremes, those of the True 
Believer* and the Infidel. While this agnostic position is not a 
strong position in the sense of having a good many logically 
compelling arguments ih its /favor, it gains its viability by virtue 
of the weaknesses in the polar alternatives. Although agnosticism 
concerning the possibility of artificial intelligence is believed to . 
be a position held by many computer scientists, there has been no 
attempt to present this position in the literature. In an attempt to 
remedy the situation,, this report presents the agnostic's position 
regarding artificial intelligence. . ( Author/ NH) 
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PREFACE * 



1 • 

The Computer and Information Science Research Center of The Ohio 
* » 

State University is an interdisciplinary research organization which 

consists of the staff) graduate students) and faculty of many University 

• * 1 
departments and laboratories. This report is based on research accom- 

plisbed in\hc Department of Computer and Information Science]. 
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ARTIFICIAL INTELLIGENCE - A CASE FOR AGNOSTICISM 



B.. Chandr asckaran . and Larry H . Reeker 



Charlie Brown: Stjo,p 



Lucy 



,p ^aj.ling me 



wishy-washy . I don ' £ like ' it , 



i Oh, yeh? O.K., tell me,^can machines think? 

s , > . > 

Charlie Brown: Well, er, let me'see; on the one hand, but . . 



Lucy 



: Wishy-washy \ 



i 




• • . • # 

A. preliminary^ version of this paper V W as presented a*t a special 
session on "The Possibilities and Limitation^. of Artificial intelli- 
gence" , during the 1971 IEEE Systems, Man, and Cybernetics Conference 
in Anaheit' California, October, 19^1 • 
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God or in the matter 
of computer simulation of the mind^ has an aura of excessive caution - the 
very opposite of bold staking out of positions. The juxtaposition: Is there 

• I 

a God? Is the mind a machine? is interesting for another reason - a sort of 
empirical semi-decidability that they share. The question about God could pre- 
sumably- be answered in the affirmative by any- given individual to whom He 
chose to provide sufficient evidence. . Likewise, a person’s doubts about ro- 
bots would probably vanish if his best friend,, about whom no suspicion had 
crossed his brow, turned out to be a clever artifact. The ppint is that it 
is possible to conceive of direct ^evidence in favor of the existence of God 
and man-machine equivalence, and difficult to imagine siich direct evidence 

i ^ 

which would compel belief in atheism or in the impossibility of machines ever- 
being built to simulate Man in all his complexity. 



Agnosticism, whether in the matter of existence of 



S 



The prospects for direct evidence are not very good in ^ither*-case at 

_ i 

u* • . 

* this time. In the matter of mechanical simulation of the human mind the in- 

* I 

direct evidence that we presently have consists of: some computer programs 

which purport to show some of the performance characteristics of the' mind., ^ 

O 



arguments attempting tb show the implausibility of a machine ever being de- 
signed fulfilling said purpo’se, arguments setting forth the likelihood of 

* . *% 

succeeding in the' enterprise of robot-building, and a mass of data on the 

• * ’ • / 

human mind itself. 



« Almost all of the published work 'on the philosophical question of the 

# * 

limitations of mechanical intelligence has argued in «£avor of one or the other 

N • ' * * 

of the polarities of possible positions: It is however possible to take a . 

position between these two extremes, those of the True Believer and the . Inf idel . 



e/ 
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While this agnostic position is not a strong position in the. sense of having 

* 

a good many logically compelling arguments in its favor (this seems to be a 

feature of agnosticism in general), it gains its Viability by virtue of the 

weaknesses in the polar alternatives. We believe agnosticism concerning the 

possibility of artificial intelligence to be a position held by many computer 

scientists . Yet there has been no attempt to present the position in the 

literature. This we attempt to ^remedy below. . 

' ' < 

• * * * 

[The computer room, a light in one comer , possibly about to fail, is causing 

* » i 

the computer to cast an intermittent long shadow- in which ijwo characters are 
standing and talking about " intelligent machines. w ] 



True Believer: I see that they are holding another computer chess tourna- 

ment ! Why, scoffers once claimed that machines woiLld never^p^ay a 
decent \ game of chess, but we now have some remarkably sophisticated 



programs. 



N 



Infidel: I doubt that they'll soon be international gratjtd masters; but 

’ then, that 1 8 beside the point anyviay. 



\ True Believer: It certainly is! Why, it' s' clearly^ only a matter of de- 

M , 1 

gree whether they are good beginning players or grandmasters % The 

• • » I 

. programs are being improved regularly. They play excellent end 

z • / . ! . . - ’ ’ J 

i/ames and+standard openings , and their look-ahead capabilities are. . 



Infidel: [interrupting]: Excuse my interruption; but you still are . 

» I * * 

missing the point: even if they become grhndmas ters, they are 
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only 8 z up id naohir.es being zcld whaz they should do. by some 
intelligent designer . People' like you are always -talking as 
if machines can think , wher a you don't even know what is meant. • 
by "tjyink. " ... 

/ 

\ ♦ 

True. Believer: ' As a matter of fact, it is not necessary to worry , 

• ** » v-' 

- 4 

about the definition.. of "think." Turing's test , the InrL - 
tation Game," is as -good an* operational definition as you 

• I * 

might need. It is going to be mighty difficult for anyone 
to deny that 'a machine which passes Turing's test has 
captured the ‘essence of thinking. 

, * 

Infidel: Certainly any one who thinks can do more than play games, 

be they chess or "imitation games, " As an exercise in pro- 
gramming fireworks, Turing's test may be something to wotk- 
towards; but as for "capturing the essence of thinking, " I 
* think it is presumptuous. Unless somebody defines "think,"* « 

I think it is unrealistic of you people... 

* 

/ 

% 

* 

True Believer: [ interrupting ]: You challenge a good operational 

definition iA favor of some muddle-headed intuition! '[Shouting, 

\ ° r 

. and beginning to flush] It's people like you who jeered at 

. « 

the steamboat} Why do there always have to be a bunch of Neander. 

' 4 • * , 

^ # * 9 

Agnostic [joining the two and interrupting]: fo, no,' fellows, let us 

0 * * i 1 

not come to blows. I can understand the vigw that the imitation 
■ ‘ game does not . embody every kind of activity that xme. might calV 



4. . 
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4 thinking . " Turing evaded that problem by saying "The 

original question , 9 can machines think ? ' is t^Jfceaningless 

0 « 

p # 

to deserve diqpussion." Stilly the imitation game is not a. 

trivial test. If a machine were to pass^that test,, it would 

« * # 

be 'evidence % that it i,s possible to build into a machine con~ 

f 

siderable mastery over language use> a capability to make 

* t . 

sophisticated inferences and deductions , a certain cunning , etc.', 
v . , 

- all evidences of intelligence if displayed by a human. 



\ 



True Believer: Yes! Look at language behavior, for one area. % Even 



ELIZA) 5 which is a very simple prQgrgm, mus.t capture certain 



© 



1 aspects of' human language since it can manage to' make some 

people, angry when they work' with it, just as they would get 

$ • , 

• angry i at a person who was answering back imperinently . 



Agnostic: ■ Hold it! I would prefer to say "just as they would get 

angry at a candy machine which was refusing to yield its candy. " 

X 

For my point is well illustrated tjy machines which "use natural 
. language, "' dnd that point is that fELIZA is more closely anal- 
ogous to a candy machine . than to a human (or even, quite pos- 
sibly, to a chimpanzee) in its real knowledge of language. I • 
think one must insist that what the machine captures is not 

. some purely superficial- aspect of some type of behavior taken 
• # 

. to be indicative of 'thought. But let us return to the imitation 

i « 

game.- I have my own reasons for considering the imitation game - 

’ . t . . .* 

.a poor operational definition. . • 



5. 



Ll 




r. 



Agnostic: While Turing ' s test provides us with a standard, or cri- 

terion, for a thinking machine, are we any nearer to designing 

\ * 

intelligent machines than we would be without the test? What 
is needed is mere thgoi just’ a criterion for thinkirig; what 
those of us who are interested in building "intelligent" programs 

s 

are lacking is a knowledge of what specific capabilities .we 
should build in. 



True Beliedlkr: What 



seem to want is a recipe, something like a 



generative ^definition of thinking. 



Infidel: What ifi thinking was just not satisfactorily definable in this 

% 

4 ) 

sense, -in_ principle? There are some very important mathematical 
objects that have this property, you know. Take for- instance, the 

,. t % < 

set of total recursive functions. Such functions are common 

9 

enough objects ; yet if you try to give a recipe for producing 
. them, you can always find one that’s not produced by that recipe. 

i 

Time Believer: - What you. are saying is Very similar to the hopes some 

■ of you were nurturing a while ago about how Go del ’s theorem was 

going to resurrect what yo'u like to' call "man’s dignity” from the 

clutches of us mechanists . Sure there are limitations to machines, 

but as Putnam** and Benacerraf and possibly others have indicated, 

* « 

there is no evidence that humans dp not po^ess similar 
.limitation's. Granted, there is no recipe to produce’ all of .the 



¥ 



J 



) 



\ 



total veduvsive junctions. But you have, yet to convince me tfxat ^ 

% 

th$ attributes of "thought" form a productive set. 

Agnostic : I agree that it is futile to loo \ c toGodel's theorem for 

* # O 

proof that the mind is not a machine. But the point about 
* • 

the difficulty in obtaining a recipe, is not so easily dismissed. 

The problem is an acute design problem. For example , as Gbdel himself 
has pointed out, very little is^ known about the processes involved - 
in thq human ability to come up with more and more precise 
distinctions as embodied, for instance , in stronger and stronger 

i 

set theoretic axioms of infinity. In order to understand the 
’•mechanisms" involved , Jie says, a major advance in the foundations 

*9 * ^ 

of mathematics is needed. Surely at this istage it is unrea- 
sonable to insist that "thinking" machines are "just around 
the comer. " One might as well claim that the ultimate 

I * 

advancd in the foundations of mathematics is imminent. 



Th 

\ui 



Is Mind a machine? We excliide from Consideration arguments* Vhich 

* # * S 

involve appeal to- religious convictions or similar essentially revealed 
knowledge of the nature of Man. Among the multiplicity* of possible posi- 
tions, the most interesting ate': 

* ...... • * 

t ;,p ■ * 10 

- 1. The mind is not a formal system,- and although one might be , 

» * 

table to program some superficial aspects of beliavior, the 

j 

\ • teally important and significant aspects of intelligence the 

• . i • * . * i 

ones that stamp us."human" - cannot be captured in a formal 

* . . • » 

• • system. . 
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2. The mind is not a formal system, but many of its activities 
* • * 
may be simulated by,^say, the digital computer. Among these 

( • 

activities proponents of this view might s include varieties 
of theorem proving, game-playing, a. limited but still exten- 

* t 

i .. .1 

sive use of natural language* and so on. But there is no. clear 

* ' 

characterization of those activities that are successfully 
mechanizable as against those that are not. 



3. The mind is a formal system, and its organization can be 

understood in sufficient de'tail in the not-too-distant future so 
that machines can be built whose ability to "think" equals if 
not surpasses that of the human mind. 



f' 4. The mind is a 
the prospects 




system, but this fact says nothing about 



building intelligent machines. Knowledge of 



the organization of the human mind of the quantity and quality 
necessary to buiid indisputably intelligent machines is just 
not available, nor is it "just around the corner." 

» 

The lifting of these four positions is meant to illustrate that there 
need not be .any close connection between one's beLief in .the equivalence of 
and machine and one' ^ belief in the possibility of writing, intelligent 



■ " T : ^ % 

programs. The mind-machine debate ( has been pursued for some time # and we shall 
• • 

not Recapitulate the details of the debate. However, in the remainder of this 
sectibn, we' will make some commentfs that bear on this question. Positions - 
3 and 4 are more fully discussed later in the ’context of complexity. 
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Consider: An ambitious engineer, with Arbitrarily- large- resources, 

% * T 

r • • ■*. i 

proposes to map' out neuron by neuron the entire "circuit-diagram*' of the brain, 
\ ~ . . 
including possibly various analog aspects of this system. ^e then hopes to * 

build a model to the detailed* specifications of’ the circi$it-<iiagram. » Apart 

* , ' \ K 



from the sheer complexity of the undertaking, ’ 'what can one say about ^his ven- 
ture? ,6uppose he doefe- eventually^succeed in. his attempts and display^ 

* . ' . v . • A ' 

before our very eyes a contraption which Is such a detailed model. What -would 



be our response? Are we then, forced to agree that could simulate the per- 



formance of the brain? As long as the possibility remains that individual 



neurons-* can be accurately modeled in principle ^and that neuron to neuron con- 



tractions can be traced in principle, then we have conceded that the mind is 
a formal system. 






Yet one can foneAee a few difficulties which might conceivably give our^ 
engineer pause before he commits his resources tb such an undertaking. Remem- 
ber, he is not to be deterred by the complexity of the job nor by the- current, 
technological limitations in terms of available probes, etc. He must, however-, 
grant that it is at least possible that some of the computations in- the 



perhaps even some fundamentally important ones, occur at (say) the quantum 

11 



mecharflcal level. (Niels Bohr, among others, has speculated on' this. ) Our - 

* * ^ ,/ 

engineer is then .forced to grant .that certain connections may in principle •• ' 

i * , ‘ • 

• ‘ ‘ * » * 

be untraceable due’ to observational limitations - to attempt to observe them. 






might mean theiy destruction* He would thefi have' to accept 'some limitations 

* dP * , ’ ' S 

' on hi^ enterprise that all his money, cannot surmount, v . 



/ 






. * * One variant of the position that mental processes ..c'annot be mechanized 

♦. «,...•* . ' * * 



is also worthy of commen^rhere. The statement is often made that the 
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of digital computer simulation of the mind is doomed sinc.e analog processes 

are .involved in the operation. of the brain, \s a ‘result, it. is further main- 

* • ' • % r. - * • ,y , . 

tained, "some type of wet engineering [ chemical * solutions and so on} may turn • 

• * ■ • • 

12 ■ - 

out to be inevitable;" Most recently, Dreyfys has emphasized this point 

* - • . * * « , . 

in his .discussions' of the. inadequancy of current approaches in artificial 

* • # . ^ ( _ 

intelligence and computer models in psychology! This. particular hurdle on the. 

*•%♦**. * 

way to .mechanization of intelligence is, for out version of • agnosticism, rather 

irrelevant* As We shall see. our agnosticism springs not so much from cons id - 
erations of inadequacy of hardware as from considerations of complexity. In 

any case, i t' appears rather.curious that a veteran critic „of artificial. intel- 

; & ^ 

ligence such as Dreyfus should suggest that the need for analog devices is 

what lies in the way of mechanization: would he rate the prospects for' machine 

« * 

intelligence any higher if the designers were allowed free use of potentiometers, 

i • 

differential analyzers, siiye wave* generators, and chemical solutions? 

* _ * 

* ‘ * * 

* 

* m 

* 

True Believer: All this dt&kussion of minds and machine 8^ doesn't interest 

me a whole lot . I am interested in building intelligent artifacts. 

You must grant that for ’a machine to pass Turing's test t it is not 
, necessary that its internal workings be identical to the. "thought 

•i* 

processes". In fact , there is bound to be a methodological dif- 
ference between simulating’' cognitive processes and designing in- 
telligent machines. 

\ . 

Agnostic: My belief is- that the behavior which must be. built into the 

machine t even to get it to flfaxy the imitation game, is so essentially 
complex that it makes little* difference whether or not it is done 
'• "the same way humans do it." Take the linguistic construct called 






"competence, ".w^ich characterizes the abstract system comprising 

^ ^ 

the grammar of a "language’ irrespective of perceptual or productive 

’ • ^ • 
constraint % of speech. There is no good evidence that, the speaker 
\\ 

» ; 

has anything .like .a linguist's bet ’of competence rules in his head. 

* V 

That is, whatever his "mental grammar" is, it resembles in 1 content 

the competence, but' its form is unknown. In dealing with a machine , 

you would have us ignore the "mental grammar" f and I will assent to 
- - * • ' * 

\ - 1 

• that. But that hardly simplifies things, for the competence itself 
, is so complex that linguists' can describe only the barest portion of 

*3 , * 



it today. 



*1 






, / * A 

True\Believer: • Objection '. The last two or three years have seen such .break- 
throughs in language processing by. computer that the linguists will 

\ 

* \ 

j soon b^Jbcoking to us for help. A lot of what linguists worry about • 
& # is silly, from our point -of view, and the current programs just don't 
deal with it because it isn't necessary. t 



Agnostic: I take it that. you are referring- to the "semantic information 

processing" programs using -natural language which have been acclaimed 
by people in artificial intelligence in the last few years. •BUt these 

K. 

programs are all so carefully tuned to a particular narrow semantic 1 

• r ’ < 

* environment that they '•are generally at a total loss outside that 

environment. And yet even within that environment, i.t is not difficult 
• • 9 * 

to find grammatical constructions such programs cannot recognize. If lingu 
■ ~ \ 

ists have only dealt with portion of the* tip of an iceberg , people . 

in artificial intelligence have only swept up a few .flakes ^of snow 
' ' # , 
on that tip. ' tfe 



11 . 



. / 3 . 



. •* 



K 



. • But of course, you maintain that frost of what linguists are doing 

1 * / * . • 
is irrelevant to programming machines to use language. I don't think 

that position, bea&s .up under close examination. Even for the machine 

to play the' imitation game , it must be able to answer questions and to 

converse in acceptable English (sayh^ and maybe some foreign 'languages 

. beside'. k, and with a fair amount of richness tq its language if it is. 'to 

\ * 

fool anyone - any set scripp, as in ElIZA , being recognizable to the 

1 • • . . . * 

clever interlocutor. Thus.it must have a built-in linguistic grammar of 
/» • 
some quality' and" extent. But producing utterances will be ttye least of 

f ’ 

its linguistic problems. It must understand anaphoric deletion and 
. » * ** . « ■*•>- 

substitution of pronouns for nouns, of "did so," or "did" for verbs, . 

* ' 

of "there" for locatives, of " that way" for some manner adverbials, and 

* % 

v . < 3 *, 

so forth. It must know that when ape say, "Harry killed Jack 9 that 

Jack is no longer alive. It must understand presuppositions of 

sentences: that ^if I say "I don't blame Harry^for killing Jahk," I am 

assuming that Harry killed Jack. *It must understand implicative verbs - 

* 

that "He forgot to shut the door" means the door wasn't shut. It must 
realize that if I say "He promised her to shovel the drive. " I am not 
referring to her shoveling the drive, as I am when I say "He told her . • 
to shovel the drive. " These are only a small sample of, the problems 



linguists are. working on; but I think you see how complex the who 



olb 



O’ 



C’ thing gets. 



True Believer: # The programs I was referring to are preliminary attempts of 
course. They show that there are heuristics which dan begin to han- 
dle the problem. All that remains is to keep at it, adding more and 
more heuristics as sthe complexity df the environment increases „ 



t 



Agno8ti‘o: I was hoping that you wouldn't say that!' Just because extremely 

simplified language environments cdn be harulled by heuristics. it -doesn't 
) ^ ' 

*. follow that heuristics piled upon heuristic* will* be able- to handle 
• * .* 
increasingly complex situations in a satis, factory manner. The system 

gets utterly impossible before long , and you have to start dll over 

* . • • • ? , 

again. You .people are fond of using a nuclear analogy to counter the 
argument that people are unpredictable while computer pjpograws are 
deterministic. Beyond a certain level of complexity , so the analogy 
goes, a program may become "critical" and start behaving. unpredictably. 
But your analogy -cuts both ways. As the designer attempts to extend 
the abilities of the machine to increasingly larger domains , the pro- . 
gram becomes increasingly large and complex until the designer is 

' * r 

* no longer able to understand' its workings well enough to continue his 
task, though he well knows he is not yet ready for Turing's test. At 
thi$ point, the program must be scrapped and rewritten. ..But that, my 

* friend , is more easily said than done ♦ 

* * * 



N 






Just how complex Is the brain? How complex would an indisputably in— 

' - 

telligent program have to be? The overall complexity of the brain is generally 

conceded, no matter how complexity is defined. On the other hand, there seems 

to be no unanimity when one comes to specific tasks. Can a machine translate 

natural languages reliably, gracefully? Surely what is meant by this question 
* • 

is not simply whether that part of the human mind which does the translation 

> 

is a formal system,- Whqt is also being asked is 2 can we decode the "program" 

usefl by the mind for this purpose sufficiently well or come up with an equiva? 

& \ 

lent one ourselves and incorporate it into a machine to do the translation.,^ * 



Fo # r language translation, one might substitute any number of other tasks 












reqtiiring intelligence. Pessimists generally date their pessimism to the 

* • / ^ 

time when they Realized just how complex the program to do any pf these 

* * 

• *• 

things at the human level would have to be. The True Believer generally 

. V - 

has two responses: 

\ 

1. The pessimist has overestimated the complexity required in a pregram. 

2. Learning and adaptive capabilities,' once mastered, will lead to 

the golden land of programs producing very, very complex behavior 

► 

of the desired kind. [We note in passing that 1$ is easy to 
produce "complex behavior"; the problem is to produce complex 
behavior that is "mind-like."] 



ERIC 
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Simon, in- his Sciences of the Art^if icial ,^ considers this problem 
of complexity* He believes he can offer a means by which arbitrary com- 

V 

i 

plexity can be built into a system. He illustrates his notion by the 
parable of the watchmakers, Hora and Tempus. Tempos so constructs his 
watches that if he has one partly assembled and is interrupted it falls to 
pieces, and he has to start all over again. On the other hand. Hora makes 
watches which are as complex as those of Tempus, but he works in a 
hierarchical fashion.. He constructs stable* subassemblies and puts these 
together to font larger subassemblies and so on. When he is interrupted, 
his already finished subassemblies do not collapse, and he starts pretty 
much where he left off. The moral is that decomposition of complex 
systems in a hierarchical manner is the key to building very, very complex 
systems. It is simple, Simon says, just write suitable hierarchical 



7 



programs^ and any ‘complex job can. be done 



15 



We 






believe that there is a problem he^ with respect- to the quantitativ* 



14. 

1*0 



I • 



«*/" ■ . I ■ 



u . 



. 'V 



o 

definition of complexity. The watch^ of Hora and.Tempus are by assertion 
equally complex.* Suppose ther watch parts are kept in properly labeled containers 

> '• ' * f ^ , 

and a robot controlled by a program* is to build the watch. The difference 

between the programs of Simon* s watchmakers is in their sizes. • Tempus* program 

* 

is evidently much larger 4 than Hora*s. Suppose now that we consider all the 

\ ^ 7* ' ( * 

possible programs that can be written for the robot which ^results in its building 

' f m , ■ . , . ’ 

identical watches and choose t^he* one which is ‘smallest in size — the number of 

% # • 

0 

bits required to store the program is as good a way as any to measure the .size. 

I t 4 • \ 

. * % * # 

Thus, the length in. bits of the shortest program is a machine-dependent but 

. * • fa 

programmer-independent measure of complexity of a watch. We yill not get into 

details of the mathematics except to indicate that if. the robot is a suitable 
, universal machine, then the machine-dependence need not be very critical. 

f 

Now, ip terms of this more precise definition of complexity, Hora is not reducing an 
inherently complex job to a simple job. He is merely being efficient in matching 
his effort to the intrinsic complexity of the job. The revised moral is that 
a task is only as complex as the simplest recipe available to accomplish it.^' 



When they differ nbout the prospects for mechanization of a certain 
intellectual task, the True Believer and the Infidel have quite different 

estimates of the intrinsic complexity’ of the required program. Another yay 

■\ * 

to put it is that they differ not so much about the behavioral complexity, but 
|the generative complexity . ^ When the True Believer offers tricks such. as 
hierarchies to reduce the difficulty, the In ff del replies that he has already 
taken them into account. 



A 



Simon expresses a version of - the True Believer's viewpoint in another 
section of his book. He considers the trajectory plotted on a piece of paper 
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of an ant making his way home on the beach. If the surface of the beach is 

M 

flat and free of obstacles such as pebbles, then the trajectory is likely to - 

be- almost a straight lin'e. On the other hand, if the surface is full of p'ebble^,-,. v 

1 . • \ 

I 

and little hills and ridges, the trajectory is very complex. "The difference in 
the complexities of the trajectories obviously has nothing to do with the "homing 

mechaqisp" of the ant* but rather reflects the differences in its environment — 

. * • 

differences betweefi a smooth*, pebble-free beach and a hilly beach strewn with 
pebbles. 'Simon then prdposes a hypothesis about human cognitive, behavior : ,r A^ 

man, viewed as a behaving system, is quite simple.* The apparent complexity. 

x\ m . # • • * - o 

of his behavior over time is largely a reflection of the complexity of the 

environment * in yrtiich he finds himself.” 

Simon has performed a service in presenting the intellectual underpinnings 

of the True Believer -in such crystal-clear fashion. If we were to choose pne 
. . * * 

statement which serves to characterize ’the beliefs of the True Believer as against 

those of both the Infidel and the Agnostic, that statement would embody the 

* < « 

content of Simon's assertion. The True Believer holds that man "as a behaving 
systejn" cannot be so complex afe to be practically beyond design. Given the 
True Believer's syllogism: "The mind is a machine; all machines can be designed; 

therefore we can design mind-like machines," the Agnostic takes exception to 
the minor premiss as unproven, asserting “the mind, may be "simply" a machine, 
but it is not a. simple machine. 

Simon proceeds to give some arguments to show why his simplicity hypo- 
thesis is a reasonable one. In fact, what those arguments show is that models 
of a first approximation to some aspects of cognitive behavior are not very 
complex - a fact which is bound to be true of first approximations to even the 
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*most complex system.* The mere historic evidence of the profound difficulties 

1 r • 

faced by artificial intelligence researchers in^ writing programs to do non- 

• • <•* ' .) ' 

* trivial problem-solving tasks (and does anyorte presently contend that after ^ 

* V * ‘ 

two decades of .work there are significantly intelligent programs in existence?) 

should alert us against the bland acceptance of the description "quite simple." 

No grand jury would indict man's mind on charges of simplicity on the basis 

S' ' ■) • 

of the evidence presented by Simon. * 

* * 

Simon does, however, make a valid point with the inspired example of 

• fhfe ant's path: the behavioral complexity of an organism or an artifact is 

at least partly due to the complexity of the environment .in which it finds it- 

% 

self. For behavior of a given degree of complexity, the internal complexity 

* ... 

required of the robot-in»-the-environment can be significantly less than that 
required of the autonompus . robot. How much less or what is left oyet after 
the environmental effects on behavior are" accounted for is an open question. 

. » i , • ' • 

. . 9 

The problem is not: is man a machine? but rather: how does one de- 
sign a man-like machine? Let us grant for a moment \ that we can slowly, but * . 

steadily, unravel the organization of the mind and incorporate each discovery 

* f 

into one program. We do not currently possess a well defined procedure for this 

unraveling - heuristic programming needs. heuristics, but we do not know how 

to guarantee generation of the necessary heuristics, given a problem-solving 

task. The process of discovering heuristics for a task is long, painful , and 

often inconclusive. This applies even in the case where the programmer is him- 

N self an expert in a given task. Chess grandmasters have a very difficult' time 

converting their ( obvious but "tacit" knowledge into heuristics for the chess 

- y 

playing program. (Newell and Simon's "-fchinjcing out loud" protocols are some help. 
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but not much, since they provide .only the* tiniest of windows into human infor- , 

* * * 

18 . . 

mat ion processing. ) As Rolanyi has made us all aware, we know^akJ.ot more than 

. - ' \ • 



„• we can say. 
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We asks just how complex a procedure is required in' general to unravel 
the.. structure of a system? An'answer to the question in thd specific context ‘ 
of artificial intelligence is likely to be another clue enabling us to- tell 



. / 






the. True Believer from the Infidel, . Even if th'ere is “Agreement- on the internal 

1 * 

complexity of the mind, the question as to the complexity of the diagnostic 

procedure required to identify its structure remains open. When the True 

• ' . . . ■ 

Believer says that* intelligent machines are "just around the corner^" he is 
simply voicing his estimate..pf the complexity of the required diagnostic pro- 

•*- V 

cedures. The Infidel's demurral is based, of course, on a very different es- 
timate- of that complexity* 

r* 

Note that the situation remains essentially the same whichever way one 
chooses to approach the design of an intelligent artifact. It is often said 

|t 

that intelligence is nothing mote than searching in a- tree, or graph,' of 

i . 

possibilities for a path from initial node to goal node. ' As is well known, 

the combinatorial explosion precludes exhaustive. search' for any but very tri- 
ll 

vial problems. One needs heuristics to control* the complexity of the search 

*#■ i ■ 

algorithm. The question now becomes: Is there a methodology which guarantees 

discovering the heuristics, and if so, what is the complexity of this method- 
ology? Again a chasm divides tje True Believer and the Infidel in their 
responses to these questions, f 




• ‘ - ' . At ' ■ 

is that there* are some tasks whidh are programmable (and have .been ®p rogrammed ) , 

. ' some tkuHr"look programmable, and some whose .prospects for mechanization \re.^ 

r * # v 20 / • '* # * * . \ 

still open- to Question.. Gunderson Has given his estimates of ptf>gram-re--\ . 

ceptive and. prograta- resistant features. But in general,' satisfactory charac- 

% ** ■ ■ . - . * * VrV‘ * \ - .* * 

. terization of programmable problems, even within a giveh state of technology, 

* •' ' * • . : % . - . ■ * t ’ 

* seems to be very' difficult . At least part of the reason for thiis % state of' 

* ** 

affairs is that estimates of: complexity- ate involved;.- these estimates, in' the 

. * , . i ' 

♦ „ * . • . ; • ■ \ 

• last analvsib. are reliable only on dn a posteriori basis -'f.e., after.- a task 

; V ' ' . - ' • • ' .. . 

< * , 

has been programmed. • 

' ■ * * * , . 

' In evaluating the role that a particular world-view - a paradigm, in 

# 

the sense of Kuhn - has played in t-he development of a science, It is worths 
while to consider not only its success in terms of its professed aims . One 
must also consider the state of the science when it was ii\ the throes of a 

previous paradigm. So it is with the artificial intelligence - cognitive 

* * « 

i 

simulation viewpoint in psychology. The uncompromising barrenness of behavior- 
ism was growing increasingly oppressive when the new ambience of the computer 
provided a ^vocabulary for talking about the internal workings of information 
processing systems, and a setting in which models df such systems could be 

* m 

s 91 ’ ' 

-s. postulated and tested with some facility. Information processing models be- . 

* ' 

. came, for a time, sources of new views and ,new experimental ideas. The lan- 

. . '» •• ’ 

guages of artificial intelligence and cognitive psychology shared many metaphors. 
There is no doubt that, in this sense at leadt, artificial intelligence has' 



paid its way. 



I 



C 



Similarly, in linguistics the dismal lack of success of the* various well 
financed attempts at machine translation brought home a point to many observers: 
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the many areas of grammar traditionally left to the ’intuitions of the speaker 



i * 



jjjust be 'made explicit. This' necessity of discovering and describing the un- 
derlying intuitions is the keynote of today's transformational-generative 
linguistics'; but the "Chomsky revolution" owed at least part of its impetus 
to attempts to make machines intelligent* * 



. * 

• 6f course, computer programs must be explicit not only in the theories 

that they embody. A level of explicitness beyond the theory - a’l£vel oon- 

' ' ' " ' 

taining many ad hoc features - is needed in order to implement the theory 

on a computer, and this forced explicitness often shifts attention from* the 

♦ 

main elemehts of a suggested theory. Thus, the claim which has sometimes been 






* ma de that computer programs are the ideal psychological theories because of 



their explicitness, or that the day is .neqr when "all psychological theories . 
are in the form of programs." id fanciful indeed. Fariciful, but not surprising. 
After all, one still hears it said that all worthwhile psychological theories 
must be in the form of stimulus- response models. We should all do our part 
to avoid the imposition of new tyrannies. 



Besides its effects on psychological and linguistic model-building, 
artificial intelligence can claim a number of other tangible achievements. _ The 



2 3 

success of MATHLAB 22 is an example. Man-machine interaction in DENDRAt, 



has achieved som$ very interesting results. Some pattern recognition programs 

v , 24 . 

for specif ic, clearly defined tasks have done very well. Papert s work on 
"teaching children thinkipg" has roots in artificial intelligence. Children 
may benefit greatly from techniques of "thinking about thinking" which lie at 
the heart of discovering heuristics in artificial intelligence. 
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Quite clearly, artificial intelligence has .produced its "spinoff" in 
• • « ^ 

the form of advances in several areas of computer science. List-processing . .* 

' and^string-processing. languages, techniques for manipulating language and othpr 
non-numerical data, and associative memories are a few examples that come to 

mt * 

mind. But the real issue remains: • Is artificial intelligence research a worth- 

• * * 

while tool in the great enterprise of understanding human thought? ■ The Agnostic 

• • 4 4 

f maintains that indeed it is, and all available tools must be put to use if .that 
enterprise is to! bear fruit. r 
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NOTES 
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1) 



" • . *•..• • .• ' K 

* • , 

Throughout the article, no special care has been taken to^nain,tain dis- 

. ♦ - 

tinctions between 'the, mind" (or ^iind*) and 'the brain', not because we 

• • » « 

are reductionists, but because we do not believe the mind-brain distinction 

’to be relevant for the burden’ of Our digQussion. We will take the /questions, 

* . •. / - 

9 # . • % • • 

"can machines think?", "are brains machines?", and "can the min^be mechan- 
ically simulated? to be very closely related for the purposes, of this. ' , 
article. • - 






2 ) 



Bertrand Rnssell’was oi\ce asked by a woman at ^ London dinner party, "Bertie,' 

\ * 

you are getting on in years and . soon going to be meeting y<5ur Maker. What 

will you say to Him. when you meet. Him?" Russell replied that he would' say, 
"Sir, why didn't yl>u give us more evidence?" 



3) One should perhaps be careful to note the distinction ^ftltween Cognitive 



Simulation (CS) and Artificial Intelligence (Ai),.^ In the former theories 



' . "ft 

about cognitive processes are postulated';' aW$. computer programs embodying the 






theories are written to see how the simulation corresponds to reality. In 
the latter, computer programs are written which perform "intelligent" • •* 
tasks without regard to correspondence between the structures of the pra- 

K. 

gram and the mind. For our purposes, however, this distinction does not 
seem' to be very crucial,' since the agnosticism that w£ plead applies to 

the prospects of both CS and AI. For this reason we have felt free, with- 

* * 

in the context of this article, to use the notion. of "mind" to apply to 
what many would call "mindlike behavior." 
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8) This may be an appropriate place to comment on another way in which the 
presumed Gdfielian implication has been rebutted. It is said that Godel 9 s 



/ . 



I 



theorem is not applicable to t the bnain because the brain is a finite sys- 



w 



tern. We think that this response begs the question. The computations that 
go on in the brain (including g/liantum-mechanical computations) majTbe,. 

' * t < 

but are not obviously, Turing ‘computations. .In fact that" is the question , t 

, * * t , 

at issue. Do. there exist physical processes which are not Turing-com- 
putable? We can only speculate at this point , but some Interpretations 

* . . .... *v .* 

by Terry Fine of a recent paper,by Chaitin ("Information-theoretic limi- 
tations^of formal systems" 'presented at- the jffiurant Institute Symposium 

* * „• -fc 

on Computational Complexity, -1971)' indicate that soine of the’ quantum-mechan- 

*\ , 

• * * % 

ical computations might be of this category in some sense. The argument 

* 

c’an be outlined as follows;** Chaitin has shown, on the basis of a 
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1 computability -based probability theory, that the nth digit of a binary 
random sequence carihet^glgenerated within time-bound f(n) where f is any 
recursive function. On the other hand, consider an experiment where elec- 
•trons-accelerated'-from’*a-cathode*tand— dl-ffracted ,,, on*pas8ihg , ~ thTough* ,,, a <1,, 8l~i L “'' < ** 



strike a screen which is divided into two regions. Let the nth digit of 

t • ' 

the binary sequence be generated on the basis of which of the two regions 

t 

.the nth electron strikes. According tp quantum mechanical considerations, 
this sequence would he an ideal Bernoulli sequence. Thus, the quantum * 
mechanical system produces the nth digit ^n a linear-bounded time. These 
' are preliminary considerations, -and it is possible that some way might be 
found to resolvd the paradox without calling into Question the Turing- 
computability of the quantum-mechanical computations. 



9) In this confe^nce. Professor Benacerraf. called attention to these views 

of Godel, who is nlso known to hdve some reservations regarding Turing's '' 

> • 

argument that, mentalnrocedures cannot go beyond the mechanical** We do 

' , ' 

not wish to repeat the substance of God el's position, except to note that 

: * i 

. to .believe', as he does, that "this process, however, today is far from 



being sufficiently understood to form a well-defined procedure" is quin- 
tessentially agnostic. 



10) We use the v t$rm "formal system"' rather loosely to denote something capable 
of exact specification, i.e. , something that,, in principle, could be simu- 



lated by a Turing machine - or by a program, on a digital computer. 



11) See Max Born, Natural Philosophy of Cause and Chance , Dover, lj)64, p. 127, 
where Bohr's insights into quantum-mechanical applications in physiology. 
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